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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address •• 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 05 May 2004 . 
2a)H This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) K Claim(s) 7-36 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) EE3 Claim(s) 1-36 is/are rejected. 

7) C3 Claim(s) 21-26 is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1. D Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 



Response to Amendment 

1 . The amendment received on 5/5/04 has been entered. Claims 1-36 remain 
pending. 



2. Claims 21-26 are objected to because of the following informalities: 

Regarding claim 21, "course" should be changed in "coarse" in lines 15 and 16. 
Claims 22-26 depend on claim 21, and are thereby objected to. 
Appropriate correction is required. 



3. The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1-4, 14, 17, 21, 24, 25, 27, and 28 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Nichani et al. (5,673,334) in view of Ueda et al. (5,271,068). 

Regarding claims 1 and 27, Nichani et al. ("Nichani") discloses a method for 
training a system to inspect a spatially distorted pattern (Col. 3, lines 65-67). The method 
comprises receiving a digitized image of an object 54 (Figure 4). The image includes a 
region of interest which is divided into a plurality of windows, thereby "sub-regions" 
(Col. 7, 36-49). Note, Nichani discloses the windows should be big enough to 



Claim Objections 



Claim Rejections - 35 USC §103 
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accommodate the uncertain orientation of the package at run time (Col. 7, 43-46). 
However, a conventional image-based inspecting method is used to reliably inspect each 
window or "sub-region" (Col. 12, lines 14-17), thereby the size of each sub-regions is 
small enough such that a conventional inspecting method can reliably inspect each of the 
sub-regions, Nichani also discloses training a fine search tool and an inspection tool for a 
respective model for each of the plurality of sub-regions (Col. 6, lines 26-30), building a 
search tree for determining an order for inspecting the plurality of sub-regions (Col. 9, 
lines 17-21), and training a coarse alignment tool 56 (Figure 4) for the region of interest 
(Col. 5, lines 55-58) so as to enable providing at run time an approximate location for a 
root sub-region of a single search tree (Figure 7; Col. 9, lines 12-67, Col. 10, lines 1-28). 
Nichani discloses constructing a minimum spanning forest constituted by a plurality of 
trees (Col. 9, lines 53-63). While Nichani does not expressly state building a single 
search tree, Nichani discloses the number of trees can be manually input (Col. 9, lines 64- 
67, Col. 10, lines 1-4). Therefore, it would have been obvious to one of ordinary skill in 
the art at the time of the invention to have modified the number of search trees disclosed 
by Nichani to include specifying a single search tree because it is well known in the art 
and would be a matter of design choice depending on the number of local alignment 
points (Col. 9, lines 64-67, Col. 10, lines 1-4). Nichani does not recognize dividing the 
region of interest in its entirety into a plurality of non-overlapping sub-regions. 
However, Ueda et al. ("Ueda") teaches that it is known to divide the region of interest 21 
in its entirety into a plurality of non-overlapping sub-regions (Figure 3a; Col. 8, lines 4- 
25). Therefore, it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have modified the dividing the region of interest disclosed by Nichani 
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to include dividing the region of interest in its entirety into a plurality of non-overlapping 
sub-regions, as taught by Ueda, because it is a methodology routinely implemented in the 



Regarding claims 14 and 21, Nichani discloses a method and apparatus for 
inspecting a spatially distorted pattern (Abstract, lines 1-2). The arguments analogous to 
those presented above for claim 1 are applicable to claim 14. Nichani discloses a 
memory for storing a digitized image of an object (Col. 5, lines 39-43), a region divider 
for dividing the digitized image of a region of interest into a plurality of sub-regions (Col. 
7 5 40-43), a coarse alignment 56, a fine search tool (Col. 3, lines 65-67) for locating each 
of the sub-regions sequentially in an ordered based on search tree information (Col. 4, 
lines 1-4), and an image-based inspector for inspecting the sub-regions (Col 4, lines 28- 



Regarding claims 2, 17, and 24, the arguments analogous to those presented 
above for claim 1 are applicable to claims 2, 17, and 24. Nichani discloses the size of the 
sub-regions being small enough such that a conventional inspecting method can reliably 
inspect each of the sub-regions. While Nichani does not recognize being able to 
approximate each of the sub-regions by an affine transformation, it would have been an 
obvious matter of design choice to specify the approximating the sub-regions by an affine 
transformation. Affine transformation is well known and routinely implemented in the 
art for correcting geometric distortions in an image, as well as for adding visual effects. 

Regarding claims 3, 25, and 28, Nichani discloses establishing the order so that 
location information for located ones of the sub-regions is used to minimize a search 
range for neighboring ones of the sub-regions (Col. 9, lines 13-40). 



art for inspection using template matching. 



29). 
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Regarding claim 4, Nichani does not appear to recognize using a correlation 
search. However, Ueda detaches that it is known to train a search tool for respective 
models for each of the plurality of sub-regions using a degree of resemblance, or 
correlation search (Col. 14, lines 5-45). Ueda discloses templates corresponding to each 
sub-region, rather than a single model. However, it would have been an obvious matter 
of design choice to have modified the templates corresponding to each sub-region 
disclosed by Ueda to include a single model for each template because it would minimize 
the time required to search each sub-region. Therefore, it would have been obvious to 
one of ordinary skill in the art at the time of the invention to have modified the training 
disclosed by Nichani to include using a correlation search as taught by Ueda because it is 
a methodology routinely implemented in the art to match a template and an image. 
5. Claims 6, 8, 10, 16, 23, 29, and 30 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nichani et al. (5,673,334) in view of Ueda et al. (5,271,068) in further 
view of Companion et al. (6,330,354). 

Regarding claim 6, Nichani discloses a method for inspecting a spatially distorted 
pattern (Col. 3, lines 65-67). The method comprises running a coarse alignment tool to 
approximately locate the spatially distorted pattern within a region of interest (Col. 1 1, 
lines 9-1 1) so as to provide an approximate location for a root sub-region of a single 
search tree (Figure 7; Col. 9, lines 12-67, Col. 10, lines 1-28), running a fine alignment 
tool in an order according to the single search tree and using the approximate location of 
the root sub-region to locate a plurality of sub-regions within the region of interest so as 
to provide fine location information (Col. 9, lines 12-67, Col. 10, lines 1-63; Col. 12, 
lines 25-67, Col. 13, lines 1-36). Note, Nichani discloses the windows should be big 
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enough to accommodate the uncertain orientation of the package at run time (Col. 7, 43- 
46). However, a conventional image-based inspecting method is used to reliably inspect 
each window or "sub-region" (Col. 12, lines 14-17) using respective models (Col. 6, lines 
26-30), thereby the size of each sub-regions is small enough such that a conventional 
inspecting method can reliably inspect each of the sub-regions using respective models. 
The arguments analogous to those presented above for claim 1 are applicable to claim 6. 
Ueda discloses producing a degree of resemblance for each of the sub-regions (Col. 8, 
lines 16-25), but does not disclose producing a difference image. However, Companion 
et al. ("Companion") teaches that it is known to produce a difference image (Abstract). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to have modified the template matching disclosed by Nichani and Ueda to 
include producing a difference image, as taught by Companion, because it is a 
methodology routinely implemented in the art in order emphasize the sub-region's 
deviation from the template to facilitate the inspection. 

Regarding claim 29, the arguments analogous to those presented above for claims 
6 and 27 are applicable to claim 29. 

Regarding claims 8, 16, 23, and 30, Nichani discloses inspecting each of the sub- 
regions using the fine location information and the image-based inspecting method (Col. 
13, lines 40-57), Nichani does not appear to specify producing both a difference image 
and a match image. However, Ueda discloses producing a correlation for each non- 
overlapping sub-region (Col. 8, lines 16-39). Companion teaches that it is known to 
produce a difference image for each of the sub-regions (Col. 5, lines 1-7). Companion 
also teaches that it is known to combine the difference images into a single difference 
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image (Col. 6, lines 10-12). Therefore, it would have been obvious to one of ordinary 
skill in the art to have modified the inspection as disclosed by Nichani to include 



images, as taught by Ueda, because it is well known in the art of template matching in 
order to further inspect each sub-region. 

Regarding claim 10, the arguments analogous to those presented above for claim 
2 are applicable to claim 10. 

6. Claims 34-36 are rejected under 35 U.S.C 103(a) as being unpatentable over 
Nichani et al. (5,673,334) in view of Ueda et al. (5,271,068) and in further view of He et 
al. (6,088,482). 

Regarding claims 34-36, the arguments analogous to those presented above for 
claim 6 are applicable to claims 34-36. Nichani and Ueda do not appear to disclose 
combining all location information to produce a distortion vector field. However, He et 
al ("He") teaches that it is known to compare location information with model location 
information so as to provide a distortion vector and to combine all location information to 
produce a distortion vector field for each sub-region (Figure 10; Col. 12, lines 33-39), He 
also teaches that it is known to allow for pass/fail decisions based on user-specified 
tolerances (Col. 7, lines 46-48). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time of the invention to have modified the location 
information disclosed by Nichani and Ueda to include producing a distortion vector field 
as taught by He because it allows for the correction of spatial distortions (Col. 5, lines 21- 



producing and combining difference images, as taught by Companion, as well as match 



23). 
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7. Claims 5 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Nichani et al. (5,673,334) and Ueda et al. (5,271,068) as applied to claims 1 and 14 
above, and further in view of Aiyer et al. (5,777,729). 

Regarding claims 5 and 20, Nichani discloses training the image-based inspection 
tool for the respective model for each of the sub-regions (Col. 6, lines 26-30). Nichani 
and Ueda do not disclose performing the training by using a golden template comparison 
method. However, Aiyer et al. ("Aiyer") teaches that it is known to train the inspection 
tool for the respective model for each of the plurality of sub-regions performed by using a 
golden template comparison method (Col. 7, lines 64-67 and Col. 8, lines 1-11). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to have modified the training of the inspection tool disclosed by Nichani and 
Ueda to use the golden template comparison method, as taught by Aiyer, in order to 
provide more effective training. 

8. Claims 7, 9, and 3 1 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Nichani et al. (5,673,334), Ueda et al. (5,271,068), and Companion et al. (6,330,354) 
as applied to claims 6 and 27 above, and further in view of He et al. (6,088,482). 

Regarding claims 7 and 31, the arguments analogous to those presented above for 
claim 34 are applicable to claims 7 and 31. 

Regarding claim 9, the arguments analogous to those presented above for claim 
34 are applicable to claim 9. Ueda discloses producing a correlation for each sub-region 
(Col. 8, lines 16-39). Companion teaches that it is known to produce a difference image 
for each of the sub-regions (Col. 5, lines 1-7). Companion also teaches that it is known to 
combine the difference images into a single difference image (Col. 6, lines 10-12). 
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Therefore, it would have been obvious to one of ordinary skill in the art to have modified 
the inspection as disclosed by Nichani to include producing and combining difference 
images, as taught by Companion, as well as match images, as taught by Ueda, because it 
is well known in the art of template matching in order to further inspect each sub-region. 

9. Claim 1 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani et 
al. (5,673,334), Ueda et al. (5,271,068), and Companion et al. (6,330,354) as applied to 
claim 6 above, and further in view of Miyake (6,009,213), 

Regarding claims 11, Nichani discloses inspecting each of the sub-regions (Col. 
13, lines 53-54). Nichani does not recognize using location information from located 
ones of sub-regions to interpolate location information for a sub-region when the sub- 
region cannot be located. However, Miyake teaches that it is known to use interpolation 
based on location information for a sub-region (Col. 5, lines 62-65), as broadly as 
claimed. Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to have modified the inspection method disclosed by Nichani, Ueda, 
and Companion to include interpolation based on location information, as taught by 
Miyake, and then use the interpolated location information to inspect the sub-region in 
order to inspect sub-regions that cannot be located. 

10. Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani et 
al. (5,673,334), Ueda et al. (5,271,068), and Companion et al. (6,330,354) as applied to 
claim 6 above, and further in view Dance et al (6,285,799). 

Regarding claim 12, Nichani discloses training a search tool and an inspection 
tool for a respective model for each of sub-regions (Col. 6, lines 26-30). Nichani does 
not recognize using the respective models for some of the sub-regions to determine 
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respective fine location information. However, Dance et al. ("Dance") teaches that it is 
known to determine location information (Col. 9, lines 63-64), Dance also teaches that it 
is known to predict fine location information using the respective location information 
(Col. 9, lines 63-65). Therefore, it would have been obvious to one of ordinary skill in 
the art at the time of the invention to have modified the training method disclosed by 
Nichani, Ueda, and Companion to include determining location information and 
predicting location information, as taught by Dance, in order to correct blurred images 
recorded by digital cameras (Col. 3, lines 6-17) and thereby compensate for training that 
was not successfully performed on a sub-region. 

11. Claim 13 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani et 
al. (5,673,334), Ueda et al. (5,271,068), and Companion et al. (6,330,354) as applied to 
claim 6 above, and further in view Aiyer et al. (5,777,729). 

Regarding claim 13, the arguments analogous to those presented above for claim 
5 are applicable to claim 13. 

12. Claim 33 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani et 
al. (5,673,334), Ueda et al. (5,271,068), and Companion et al. (6,330,354) as applied to 
claim 6 above, and further in view Clark et al. (6,370,197). 

Regarding claim 33, Nichani discloses using a search tool to locate the plurality of 
sub-regions (Col. 9, lines 17-21), Nichani does not disclose dividing the sub-regions into 
smaller sub-regions when one of the sub-regions cannot be located. However, Clark et 
al. ("Clark") teaches that it is known to further sub-divide a block or "sub-region" when a 
condition is not met after inspection of the sub-region (Abstract, lines 2-7). Therefore, it 
would have been obvious to one of ordinary skill in the art to have modified the fine 
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search tool disclosed by Nichani, Ueda, and Companion to include dividing one of the 
non-overlapping sub-regions into a plurality of smaller sub-regions when the one of the 
sub-regions cannot be located during the use of the search tree information by applying 
Clark's teaching to further sub-divide a sub-region when a condition is not met, in order 
to locate the sub-region that could not be located by the search tree information. 

13. Claims 15 and 22 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Nichani et al. (5,673,334) and Ueda et al. (5,271,068) as applied to claims 14 and 21 
above, and further in view of He et al. (6,088,482). 

Regarding claims 15 and 22, the arguments analogous to those presented above 
for claim 7 are applicable to claims 15 and 22. 

14. Claims 18, 26, and 32 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Nichani et al. (5,673,334) and Ueda et al (5,271,068) as applied to claims 14, 21, 
and 27 above, and further in view of Miyake (6,009,213). 

Regarding claims 18, 26, and 32, the arguments analogous to those presented 
above for claim 1 1 are applicable to claims 18, 26, and 32. 

15. Claim 19 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani et 
al. (5,673,334) and Ueda et al. (5,271,068) as applied to claim 14 above, and further in 
view Dance et al. (6,285,799). 

Regarding claim 19, the arguments analogous to those presented above for claim 
12 are applicable to claim 19. 
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Response to Arguments 



16. Applicant's arguments filed 5/5/04 have been fully considered but they are not 
persuasive. 

Summary of Applicant's Argument: Nichani does not disclose an image-based 
inspection method such as Golden Template Analysis, or Patlnspect, as taught by the 
Applicant. Nichani teaches away from using a single search tree. Ueda teaches away 
from using non-overlapping sub-regions. Applicant's invention uses only a fine search 
tool to search within a plurality of non-overlapping sub-regions whereas Nichani uses a 
coarse alignment tool to search a plurality of windows. Nichani teaches away from 
combination with Companion. 

Examiner's Response: Nichani discloses an image-based inspection method (Col. 
5, lines 23-34, 49-54; Col. 6, lines 9-21; Col. 9, lines 1-9; Col. 11, lines 6-46; and Col. 
13, lines 40-67, Col. 14, lines 1-35). The independent claims do not include the 
limitation of Golden Template Analysis or Patlnspect, but merely an image-based 
inspection. As indicated by the Applicant (Page 23, para. 4), Nichani teaches three 
parameters that together are used to determine the presence/absence of a check-mark 
(Col. 13, lines 40-57). The three parameters, average of the gray level value, edge count, 
and shape score, are all based on the image (Col. 13, lines 58-67, Col. 14, lines 1-34). 
Nichani does not teach away from using a single search tree. Nichani discloses a single 
search tree in Figure 7. The number of trees would be a matter of design choice 
depending on the number of alignment points. Ueda expressly discloses dividing a 
region of interest in its entirety into a plurality of non-overlapping sub-regions (Figure 
3a; Col. 9, lines 34-63) such that a conventional inspecting method can reliable inspect 
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each of the sub-regions. As noted by the Applicant (Page 25, para. 2), Ueda states that 
the subregions are formed so that adjacent subregions overlap (Col. 3, lines 24-25). 
However, Ueda discloses that the subregions are further subdivided into a plurality of 
non-overlapping parts (Col. 9, lines 34-63). Therefore, the subregion 21 (Figure 3a) 
disclosed by Ueda is the region of interest that is divided in its entirety into a plurality of 
non-overlapping sub-regions as shown in Figure 3a. Nichani discloses both coarse 
alignment and fine alignment (Figure 4). The claim language does not exclude the use of 
a coarse alignment tool. Nichani discloses an image-based inspection method (Col. 13, 
lines 40-67, Col. 14, lines 1-35). Companion discloses an image-based inspection 
method (Abstract). Nichani and Companion are combinable because they are from the 
same field of endeavor. 



17. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of 
time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 . 1 36(a) will be calculated from the mailing date of the 
advisory action. In no event, however, will the statutory period for reply expire later than 
SIX MONTHS from the mailing date of this final action. 



Conclusion 



Application/Control 
Art Unit: 2623 




iber: 09/451,084 




Page 



Contact Information 



18. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Virginia M Kibler whose telephone number is (703) 306- 
4072. The examiner can normally be reached on Mon-Thurs 8:00- 5:30 and every other 
Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amelia Au can be reached on (703) 308-6604. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 




MEHUDAD DASTOURI 
PRIMARY EXAMINER 



Virginia Kibler 
07/21/04 




